Two generic mechanisms for emergence of direction selectivity coexist in recurrent neural networks

Poster presentation: Twenty Second Annual Computational Neuroscience Meeting: CNS*2013. Paris, France. 13-18 July 2013. In the mammalian visual cortex, the time-averaged response of many neurons is maximal for stimuli moving in a particular direction. Such a direction selective response is not found in LGN, upstream of the visual processing pathway, suggesting that cortical networks play a strong role in the generation of direction selectivity. Here we investigate the mechanisms for the emergence of direction selectivity in the recurrent networks of nonlinear firing rate neurons in layer 4 of V1 receiving the input from LGN. In the model the LGN inputs are characterized by different receptive field positions, and their relative temporal phase shifts are reversed for the stimuli moving in the opposite direction. We propose that two distinct mechanisms result in the neuronal direction selective response in these recurrent networks. The first one is a result of nonlinear feed-forward summation of several time-shifted inputs. The second mechanism is based on the competition between neurons for firing in a winner-take-all regime. Both mechanisms rely on inhibitory interactions in the connectivity matrix of lateral connections, but the second one involves inhibitory loops. Typically, the first mechanism results in lower selectivity values than the second, but the time-course of acquiring direction selective response is faster for the first mechanism. Importantly, the two mechanisms have different input frequency tuning. The first mechanism, based on the nonlinear summation, result in a relatively narrow tuning curve around the preferred frequency of the stimulus in the case of the moving grating. In contrast, the direction selectivity arising from the second mechanism depends only weakly on the input frequency, i.e. has a broader tuning curve. These differences allow us to provide the recipe for identifying in experiment which of the two mechanisms is used by a given direction selective neuron. We then analyze how the statistics of the connections in the random recurrent networks affect the relative contributions from these two mechanisms and determine the distributions of the direction selectivity values. We identify the motifs in the connectivity matrix, which are required for each mechanism and show that the minimal conditions for both mechanisms are met in a very broad set of random recurrent networks with sufficiently strong inhibitory connections. Thus, we propose that these mechanisms coexist in generic recurrent networks with inhibition. Our results may account for the recent experimental observations that direction selectivity is present in dark-reared mice and ferrets [1,2]. It can also explain the emergence of direction selectivity in species lacking a spatially organized direction selectivity map

Coordinated optimization of visual cortical maps : 2. Numerical studies

In the juvenile brain, the synaptic architecture of the visual cortex remains in a state of flux for months after the natural onset of vision and the initial emergence of feature selectivity in visual cortical neurons. It is an attractive hypothesis that visual cortical architecture is shaped during this extended period of juvenile plasticity by the coordinated optimization of multiple visual cortical maps such as orientation preference (OP), ocular dominance (OD), spatial frequency, or direction preference. In part (I) of this study we introduced a class of analytically tractable coordinated optimization models and solved representative examples, in which a spatially complex organization of the OP map is induced by interactions between the maps. We found that these solutions near symmetry breaking threshold predict a highly ordered map layout. Here we examine the time course of the convergence towards attractor states and optima of these models. In particular, we determine the timescales on which map optimization takes place and how these timescales can be compared to those of visual cortical development and plasticity. We also assess whether our models exhibit biologically more realistic, spatially irregular solutions at a finite distance from threshold, when the spatial periodicities of the two maps are detuned and when considering more than 2 feature dimensions. We show that, although maps typically undergo substantial rearrangement, no other solutions than pinwheel crystals and stripes dominate in the emerging layouts. Pinwheel crystallization takes place on a rather short timescale and can also occur for detuned wavelengths of different maps. Our numerical results thus support the view that neither minimal energy states nor intermediate transient states of our coordinated optimization models successfully explain the architecture of the visual cortex. We discuss several alternative scenarios that may improve the agreement between model solutions and biological observations

Coordinated optimization of visual cortical maps : 1. Symmetry-based analysis

In the primary visual cortex of primates and carnivores, functional architecture can be characterized by maps of various stimulus features such as orientation preference (OP), ocular dominance (OD), and spatial frequency. It is a long-standing question in theoretical neuroscience whether the observed maps should be interpreted as optima of a specific energy functional that summarizes the design principles of cortical functional architecture. A rigorous evaluation of this optimization hypothesis is particularly demanded by recent evidence that the functional architecture of orientation columns precisely follows species invariant quantitative laws. Because it would be desirable to infer the form of such an optimization principle from the biological data, the optimization approach to explain cortical functional architecture raises the following questions: i) What are the genuine ground states of candidate energy functionals and how can they be calculated with precision and rigor? ii) How do differences in candidate optimization principles impact on the predicted map structure and conversely what can be learned about a hypothetical underlying optimization principle from observations on map structure? iii) Is there a way to analyze the coordinated organization of cortical maps predicted by optimization principles in general? To answer these questions we developed a general dynamical systems approach to the combined optimization of visual cortical maps of OP and another scalar feature such as OD or spatial frequency preference. From basic symmetry assumptions we obtain a comprehensive phenomenological classification of possible inter-map coupling energies and examine representative examples. We show that each individual coupling energy leads to a different class of OP solutions with different correlations among the maps such that inferences about the optimization principle from map layout appear viable. We systematically assess whether quantitative laws resembling experimental observations can result from the coordinated optimization of orientation columns with other feature maps

Passive Mechanical Forces Control Cell-Shape Change during Drosophila Ventral Furrow Formation

AbstractDuring Drosophila gastrulation, the ventral mesodermal cells constrict their apices, undergo a series of coordinated cell-shape changes to form a ventral furrow (VF) and are subsequently internalized. Although it has been well documented that apical constriction is necessary for VF formation, the mechanism by which apical constriction transmits forces throughout the bulk tissue of the cell remains poorly understood. In this work, we develop a computational vertex model to investigate the role of the passive mechanical properties of the cellular blastoderm during gastrulation. We introduce to our knowledge novel data that confirm that the volume of apically constricting cells is conserved throughout the entire course of invagination. We show that maintenance of this constant volume is sufficient to generate invagination as a passive response to apical constriction when it is combined with region-specific elasticities in the membranes surrounding individual cells. We find that the specific sequence of cell-shape changes during VF formation is critically controlled by the stiffness of the lateral and basal membrane surfaces. In particular, our model demonstrates that a transition in basal rigidity is sufficient to drive VF formation along the same sequence of cell-shape change that we observed in the actual embryo, with no active force generation required other than apical constriction

Self-organization and the selection of pinwheel density in visual cortical development

Self-organization of neural circuitry is an appealing framework for understanding cortical development, yet its applicability remains unconfirmed. Models for the self-organization of neural circuits have been proposed, but experimentally testable predictions of these models have been less clear. The visual cortex contains a large number of topological point defects, called pinwheels, which are detectable in experiments and therefore in principle well suited for testing predictions of self-organization empirically. Here, we analytically calculate the density of pinwheels predicted by a pattern formation model of visual cortical development. An important factor controlling the density of pinwheels in this model appears to be the presence of non-local long-range interactions, a property which distinguishes cortical circuits from many nonliving systems in which self-organization has been studied. We show that in the limit where the range of these interactions is infinite, the average pinwheel density converges to $\pi$. Moreover, an average pinwheel density close to this value is robustly selected even for intermediate interaction ranges, a regime arguably covering interaction-ranges in a wide range of different species. In conclusion, our paper provides the first direct theoretical demonstration and analysis of pinwheel density selection in models of cortical self-organization and suggests to quantitatively probe this type of prediction in future high-precision experiments.Comment: 22 pages, 3 figure

Coordinated optimization of visual cortical maps (I) Symmetry-based analysis

In the primary visual cortex of primates and carnivores, functional architecture can be characterized by maps of various stimulus features such as orientation preference (OP), ocular dominance (OD), and spatial frequency. It is a long-standing question in theoretical neuroscience whether the observed maps should be interpreted as optima of a specific energy functional that summarizes the design principles of cortical functional architecture. A rigorous evaluation of this optimization hypothesis is particularly demanded by recent evidence that the functional architecture of OP columns precisely follows species invariant quantitative laws. Because it would be desirable to infer the form of such an optimization principle from the biological data, the optimization approach to explain cortical functional architecture raises the following questions: i) What are the genuine ground states of candidate energy functionals and how can they be calculated with precision and rigor? ii) How do differences in candidate optimization principles impact on the predicted map structure and conversely what can be learned about an hypothetical underlying optimization principle from observations on map structure? iii) Is there a way to analyze the coordinated organization of cortical maps predicted by optimization principles in general? To answer these questions we developed a general dynamical systems approach to the combined optimization of visual cortical maps of OP and another scalar feature such as OD or spatial frequency preference.Comment: 90 pages, 16 figure

Coordinated optimization of visual cortical maps (II) Numerical studies

It is an attractive hypothesis that the spatial structure of visual cortical architecture can be explained by the coordinated optimization of multiple visual cortical maps representing orientation preference (OP), ocular dominance (OD), spatial frequency, or direction preference. In part (I) of this study we defined a class of analytically tractable coordinated optimization models and solved representative examples in which a spatially complex organization of the orientation preference map is induced by inter-map interactions. We found that attractor solutions near symmetry breaking threshold predict a highly ordered map layout and require a substantial OD bias for OP pinwheel stabilization. Here we examine in numerical simulations whether such models exhibit biologically more realistic spatially irregular solutions at a finite distance from threshold and when transients towards attractor states are considered. We also examine whether model behavior qualitatively changes when the spatial periodicities of the two maps are detuned and when considering more than 2 feature dimensions. Our numerical results support the view that neither minimal energy states nor intermediate transient states of our coordinated optimization models successfully explain the spatially irregular architecture of the visual cortex. We discuss several alternative scenarios and additional factors that may improve the agreement between model solutions and biological observations.Comment: 55 pages, 11 figures. arXiv admin note: substantial text overlap with arXiv:1102.335

Integration of contractile forces during tissue invagination

Contractile forces generated by the actomyosin cytoskeleton within individual cells collectively generate tissue-level force during epithelial morphogenesis. During Drosophila mesoderm invagination, pulsed actomyosin meshwork contractions and a ratchet-like stabilization of cell shape drive apical constriction. Here, we investigate how contractile forces are integrated across the tissue. Reducing adherens junction (AJ) levels or ablating actomyosin meshworks causes tissue-wide epithelial tears, which release tension that is predominantly oriented along the anterior–posterior (a-p) embryonic axis. Epithelial tears allow cells normally elongated along the a-p axis to constrict isotropically, which suggests that apical constriction generates anisotropic epithelial tension that feeds back to control cell shape. Epithelial tension requires the transcription factor Twist, which stabilizes apical myosin II, promoting the formation of a supracellular actomyosin meshwork in which radial actomyosin fibers are joined end-to-end at spot AJs. Thus, pulsed actomyosin contractions require a supracellular, tensile meshwork to transmit cellular forces to the tissue level during morphogenesis.American Cancer Society (grant PF-06-143-01-DDC)National Institutes of Health (U.S.) (NIH/NIGMS, P50 grant GM071508)National Institutes of Health (U.S.) (NIH/NIGMS, R01 grant GM079340)Eunice Kennedy Shriver National Institute of Child Health and Human Development (U.S.) (grant 5R37HD15587)Howard Hughes Medical Institute (Investigator

Natural Image Coding in V1: How Much Use is Orientation Selectivity?

Orientation selectivity is the most striking feature of simple cell coding in V1 which has been shown to emerge from the reduction of higher-order correlations in natural images in a large variety of statistical image models. The most parsimonious one among these models is linear Independent Component Analysis (ICA), whereas second-order decorrelation transformations such as Principal Component Analysis (PCA) do not yield oriented filters. Because of this finding it has been suggested that the emergence of orientation selectivity may be explained by higher-order redundancy reduction. In order to assess the tenability of this hypothesis, it is an important empirical question how much more redundancies can be removed with ICA in comparison to PCA, or other second-order decorrelation methods. This question has not yet been settled, as over the last ten years contradicting results have been reported ranging from less than five to more than hundred percent extra gain for ICA. Here, we aim at resolving this conflict by presenting a very careful and comprehensive analysis using three evaluation criteria related to redundancy reduction: In addition to the multi-information and the average log-loss we compute, for the first time, complete rate-distortion curves for ICA in comparison with PCA. Without exception, we find that the advantage of the ICA filters is surprisingly small. Furthermore, we show that a simple spherically symmetric distribution with only two parameters can fit the data even better than the probabilistic model underlying ICA. Since spherically symmetric models are agnostic with respect to the specific filter shapes, we conlude that orientation selectivity is unlikely to play a critical role for redundancy reduction